arXiv:1504.05684vl [math.NT] 22 Apr 2015 


A RELATIVE TRACE FORMULA FOR A COMPACT RIEMANN 

SURFACE 

KIMBALL MARTIN, MARK MCKEE, AND ERIC WAMBACH 


Abstract. We study a relative trace formula for a compact Riemann surface 
with respect to a closed geodesic C. This can be expressed as a relation between 
the period spectrum and the ortholength spectrum of C. This provides a new 
proof of asymptotic results for both the periods of Laplacian eigenforms along 
C as well estimates on the lengths of geodesic segments which start and end 
orthogonally on C. Variant trace formulas also lead to several simultaneous 
nonvanishing results for different periods. 


1. Introduction 

Let S) be the upper half plane, V a discrete cofinite subgroup of G = PSL 2 (K) 
and X = r\jo be the quotient space. Let A denote the hyperbolic Laplacian on X, 
and {4>n} be an orthonormal basis of A-eigenfunctions for the discrete spectrum of 

LHX). 

In the case of F = PSL 2 (Z), Kuznetsov [17] and Bruggeman |3] independently 
derived a formula, known as the Kuznetsov(-Bruggeman) (sum or trace) formula, 
which essentially relates the Fourier coefficients of the ’s with Kloosterman sums 
S{n,m,c). As in the case of the Selberg trace formula, both sides of the formula 
involve a test function. This implies estimates on sums of Fourier coefficients as 
well as estimates on sums of Kloosterman sums. The Kuznetsov formula has been 
generalized to other F, but we will not go into that here; see [T2] for more details. 

The Kuznetsov trace formula is similar to the Selberg trace formula and this 
is perhaps most clearly seen from the point of view of Jacquet’s relative trace 
formula. For an appropriate test function / : G —^ K, one forms an associated 
kernel K{x, y) : F\G x F\G —M which is 

K{x,y) = = ^K^^{x,y) + K^is{x,y), 

7 Gr n 

where the terms on the right encode certain spectral information. The left hand 
expansion is known as the geometric expansion and the right hand side is the 
spectral expansion. The Selberg trace formula comes by integrating each expansion 
over the diagonal F\G C F\G x F\G. Let A be a unipotent subgroup of G. 
When Fjv = F n A is nontrivial, integrating the two expansions for the kernel over 
FAr\A X Fjv\A essentially gives the Kuznetsov formula. 

Now one can of course integrate K(x,y) over other product subgroups, yielding 
what are now called relative trace formulas, and one particular case of interest is 
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the following. Let iL be a torus of G and suppose Th =T D H is nontrivial. Then 
integrating K^^{x,y) over Th\H x Th\H yields the square of a period integral of 
(pn- This was studied in detail in the adelic context in [n, m in connection with 
L-values. 

The relative trace formula has proved to be a powerful tool in studying periods 
and L-functions. However, little has been done, except in the classical Kuznetsov 
case, to understand the role of the relative trace formula in spectral geometry, 
especially in light of the applications of the Selberg trace formula in this field. We 
propose to study here the classical analogue of the relative trace formula in [T 3 ] , for 
simplicity, in the case where X is compact. This formula provides a new relation 
between what might be called the period spectrum and the ortholength spectrum 
relative to a fixed closed geodesic C on X. Consequently we give a new proof of 
some asymptotic results for these periods and ortholengths. We hope this will be 
of interest both from the point of view of the study of compact Riemann surfaces, 
and from the point of view of better understanding the relative trace formula. Now 
we describe our work in greater detail. To put it in context, we recall some facts 
about the Selberg trace formula. 


Suppose X = r\i5 be a smooth compact (hyperbolic) Riemann surface. Let 
{pn} be an orthonormal basis of eigenforms of A in L^(X) with corresponding 
eigenvalues A„. 

The Selberg trace formula is a powerful tool for studying the spectral geometry of 
X (e.g., [18], [10]). Instead of working with a kernel on r\G as mentioned above, we 
will work directly with a kernel on A, as in [10]. For a suitable test function $ one 
associates a kernel K : X x X ^ R, and integrates K over the diagonal X C X x X 
to get the Selberg trace formula. This formula relates a sum over conjugacy classes 
of r of orbital integrals (the geometric side) with the eigenvalues A„ (the spectral 
side). The nontrivial conjugacy classes of T are in one-to-one correspondence with 
classes of closed geodesics on X, and the geometric side may be expressed in terms 
of the volume of X and the lengths of shortest primitive closed geodesics on X. 
The collection of these lengths is called the length spectrum of A, so the Selberg 
trace formula relates the length spectrum with the eigenvalue spectrum {A„} of A. 

By varying appropiate test functions <i>, one is able to use the trace formula to 
get many beautiful results. We mention two. The first is Weyl’s law: 


# {An < x} 


vol(A) 

—:- X as a: —>■ oo. 

4?! 


The second is the Prime Geodesic Theorem: if 7 ro(a:) denotes the number of closed 
oriented geodesics 7 with norm less than x, then 


TToix) 


X 

logx 


The setup for our relative trace formula is as follows. Fix a closed geodesic C 
on A. We integrate the kernel K on the product subspace G x G of A x A against 
a “character” y of G (cf. Section |S]) . This is the compact classical (non-adelic) 
version of the GL(2) relative trace formula in [1^. The spectral side of this trace 
formula is 


^/i(r„)|Px (</)„) P 
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where h is the Selberg transform of An = j and Px{4>) denotes the twisted 
period 

JC 

We may think of these twisted periods as Fourier coefficients of (j) along C. In 
analogy with the Selberg trace formula, we will call the sequence {Px{4’n)} the 
{x-)period spectrum for C. 

The geometric side is a sum over double cosets rc\r/rc of (relative) orbital 
integrals, where Fc is the stabilizer of C in F. The nontrivial double cosets corre¬ 
spond to the finitely many self-intersection points on C and the orthogonal spectrum 
of C, by which we mean the set of geodesic segments which start and end on C 
and meet C orthogonally at both ends. One can order these geodesic segments by 
length, and we call the sequence of these lengths the (real) ortholength spectrum 
of C. In Section we express the geometric side in terms of the length of C, its 
angles of self-intersection, and its ortholength spectrum. (For simplicity, we only 
write this formula down for a general test function when y is trivial, though the 
case of X nontrivial is similar.) 

Hence we discover that the relative trace formula provides a relation between the 
period spectrum and the ortholength spectrum of C. The analogue of the Selberg 
trace formula applications mentioned above would be asymptotics for the period 
and ortholength spectra. In the present paper, we use this relative trace formula 
to obtain average asymptotics and various nonvanishing results for the periods, as 
well as asymptotic bounds for the ortholength spectrum. This trace formula also 
suggests many questions beyond the present work. An obvious one is how precise 
can we make these asymptotics? But other kinds of questions naturally arise also: 
for instance, do the ortholength and period spectra determine each other, as is the 
case with the length and eigenvalue spectra? (It is known they do not determine 
the surface [28|.l 


Let us first discuss the period asymptotics. In the case where F is an arithmetic 
group, these periods are related to special values of L-functions and Fourier coeffi¬ 
cients of modular forms (e.g., [26)1. Less is known about them in the non-arithmetic 
case. For a general (cocompact) F, quantum ergodic results ([ 21 ], | 1 ], [ 21 ]) state 
that the functions (pn become equidistributed with respect to an area measure, ex¬ 
cept for a possible exceptional (density 0) subsequence. In the case of hyperbolic 
surfaces, a conjecture of Rudnick and Sarnak [53] asserts that this thin subsequence 
should be empty. (See [9] for remarkable recent work when F = SL 2 (Z).) In a sim¬ 
ilar vein, one expects the periods P{(j)n) = ^ 0. In fact, one can show is the 

asymptotic 


( 1 ) 


Xn. <31 


len(C) ^ 
- y/x. 

TT 


Note that © says that, on average, P{<pn) is about This of course implies 

that, apart from a possible exceptional subsequence, P^pn) 0. 

The equation o seems to have first been stated in m by analyzing Dirichlet 
series and using the automorphic Green’s kernel, however no proofs are given. Sub¬ 
sequently, Good [5] extended Kuznetsov’s formula to the case of Fourier coefficients 
along geodesics (as well as other cases), for both F compact and non-compact. A 
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consequence is an asymptotic of the above form. Unfortunately, [6] is rather dif¬ 
ficult to penetrate, and it seems this work is not well understood. (See also [7].) 
Additionally, the Fourier coefficients in [B] are not exactly the periods appearing in 
m —the asymptotic in j6l Theorem 2] is of different order! Later Zelditch [28], then 
Ji and Zworski [15], obtained analogues of m in a general context using the wave 
kernel. Recently, |21] has proved a formula similar to the one in [6] for compact 
Riemann surfaces and again obtains o, and [25] proves an analogue of o for some 
compact and non-compact arithmetic F using Green’s functions. 

Our first application of the relative trace formula is a new proof of ([T]). To do 
this, we observe that the natural choice for a test function in our relative trace 
formula is <f>(a;) = , which appears to have not been considered previously. The 

reason for this choice of <f>, is that in general the geometric side involves some rather 
complicated elliptic integrals, but for $(ai) = they degenerate into AT-Bessel 
functions. We work out the trace formula in this case in Section [3] (for simplicity 
still with X trivial), and see it yields a rather striking limit formula: 

(2) lim Kir^ {t)\P{(j)n)\‘^ = ilength(C'). 

Since each ^ this immediately implies that an infinite number 

of P{(j)nYs are nonvanishing. As this is related to nonvanishing of L-values in 
the arithmetic case, this seems to be a nontrivial statement, despite its apparent 
simplicity. 

In order to get o, we would like to use a Tauberian argument. While estimates 
for Kir(t) in either r or t, keeping the other fixed, are classical and well known, in 
our situation one needs uniform estimates for Kir(t) when both r and t are allowed 
to vary, which is a much more subtle problem. These estimates, which seem new, 
are carried out in Section (T] This allows us to conclude ([U (see Theorem [3] below). 

In Section]^ we consider the relative trace formula for twisted periods ((/>„), 
which are of interest in number theory. In particular we show © also holds for 
P^{(j)n) (Theorem[3]) . In the arithmetic case, we remark one should be able to obtain 
similar estimates from subconvexity. It is also likely that the other approaches 
mentioned above can be modified to deal with the case of twisted periods. By 
allowing for two different characters yi and X‘2 our trace formula, we also obtain 
simultaneous nonvanishing results for two different twists (((>„) and Px 2 i 4 ‘n)- 
Such simultaneous nonvanishing statements are typically quite difficult to prove. 

A natural question then would be an analysis of the error term in ([!]) . Both m 
and [28] conclude the error term is 0(1), while [21] obtains a weaker error bound 
of 0(loga;). To obtain this, [55] uses a Tauberian theorem of Hormander which 
gives a sharp bound on the remainder. For our setup, we are required to use a 
different Tauberian theorem, for which a very crude error bound can be obtained 
by Tauberian remainder theory. Of course, with either further analysis (similar 
to that done for Weyl’s estimate with remainder) or a sharp Tauberian remainder 
theorem, one should expect the same error bound to come out of our approach, but 
that is not one of our goals here. The very crude bound on the error coming out of 
existing Tauberian remainder theory is explained at the end of Section |4j 

In most of the abovementioned works that study m, a slightly more general 
setup is studied where one considers two closed geodesics Ci and C 2 , and the 
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product of periods 



Of course this can be treated with a relative trace formula by integrating the kernel 
over Cl X ( 72 , however the nature of the asymptotics of the sum of these products 
of periods are different than o when Cl ^ € 2 - The trace formula in this case is 
essentially the same as the case of C x C, except that here the “main” geometric 
term vanishes and the spectral terms are no longer positive, so it is not as easy to get 
asymptotics. In Section [5] we look briefly at this case and show there are infinitely 
many such that the periods ipn and (pn are simultaneously nonvanishing. 

Finally, we come to the discussion of the ortholength spectrum. Ortholength 
spectra were introduced for general hyperbolic manifolds in [ 2 ] (called orthogonal 
spectra there) as well as with additional structure (complex ortholength spectra) in 
3 dimensions by m- The paper [5] concerns a much more general setup than just 
two curves, but consider the following situation. Let Ci and C 2 be closed geodesics 
on X. Let 0{X\ (7i, ( 72 ) denote the full orthogonal spectrum of X relative to (7i and 
( 72 , by which we mean the set of common orthogonals which start on (7i and end 
on € 2 - One can write (7(X; (7i, ( 72 ) = Ufc ^k{X-,Ci,C 2 ) where each Ok{X]Ci,C 2 ) 
is the subset of (7/c(7f; (7i, ( 72 ) comprised of curves which cross C 2 exactly k times. 
In this context, the main theorem of [5] essentially states that if (7i and C 2 are 
disjoint and simple, 

(3) ^ logcoth = 21en((7i). 

7GOfc(A;Ci,C2) ^ 


This is rather striking and is a sort of relative analogue of McShane’s identity. Un¬ 
fortunately, the author then claims an asymptotic on the growth of Ok{X] (7i, ( 72 ), 
but this clearly cannnot follow from just ([3]) as suggested in [5]. Indeed such asymp¬ 
totics are rather slippery as we will see below. 

In any case, we are interested in asymptotics for the full ortholength spectrum of 
(7 (not necessarily simple), which is a natural consideration in light of our relative 
trace formula. However this problem is not explicitly studied in the previously men¬ 
tioned works studying o, though related problems are considered in (BJ Chapter 
11]. Define S('y) = 2cosh(len( 7 )) (which is approximately for long 7 ) and 

set 

7^s(x) = #{76 0(X;C,C) : S(j) < xj = '^7rf\x). 

Lattice point estimates used in Section[3]yield a very crude bound of Trs{x) = 0(x'^). 
To get better estimates we consider our relative trace formula from Section [3] with 
the test function <I>(x) = e~*^ sending t 0 in Section[3 This yields an asymptotic 
roughly of the form 





len((7)^ 
vol(7f) t 


as t —>■ 0 '*', 


where the sum on the left is over 6 = 6{'-f) for 7 G 0{X-, (7, (7). This gives an upper 
bound of 

TTs{x) = O as X —>■ 00 


and a lower bound of 


715 (x) ^ ® as X —>■ 00 





6 


KIMBALL MARTIN, MARK MCKEE, AND ERIC WAMBACH 


for any e > 0. 

We remark that this situation is analogous with that described in [10], where 
one can use the heat kernel with t —>■ oo to obtain Weyl’s law. On the other hand, 
sending t 0 yields information on the geometric terms, but to get the full Prime 
Geodesic Theorem, one needs to choose another kernel. Similarly, one expects that 
a different choice of kernel here should lead to a precise asymptotic on tts(x). It 
would be interesting to see what other kernels give, but do not do this now. Instead, 
in Section O we will interpret Good’s work |5| in this context to conclude 


715(0;) 


len(C)^ 
7rvol(X) ’ 


as well as give asymptotic bounds for the growth of 0(X; Ci, 02 )- The manuscript 
[B] is a rather thorough generalization of Kuznetsov’s formula for G = PSL 2 (K), but 
it is not evident what results follow from these formulas. Hence this section may 
be useful for anyone trying to understand |B]. Finally, we note that the approach 
in [^ is more complicated than ours in several ways, even if one restricts to the 
case of smooth compact X. This, along with the problem of obtaining an exact 
asymptotic for 0 {X-,Ci,C 2 ), suggests a more detailed study of the relative trace 
formula we consider here may be of interest. 
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2. The relative trace formula 


2.1. The setup. Recall the identification X = r\ij. It can be chosen so that the 
preimage of C in is iK.’*'. For simplicity, we assume C is primitive, i.e., it does 
not wrap around itself. Let Fg be the diagonal subgroup of F, so that C = ro\iIR+. 
We may write 

r. = ((’" 

where m > I. 

Next recall the usual setup for the Selberg trace formula on X, e.g., as presented 
in [TU]. Let 

d{z, w) = cosh“^(I + u{z, w)/2) 
be the hyperbolic distance in the upper half plane, where 


u{z, w) = 


\z — w\ 


Let $ be a smooth function on ]R>o which decays rapidly at infinity, i.e., = 

0{x~^) for all N > 0. We form the kernel 

K{z, w) = ^{u{'yz, w)). 

IGT 


(4) 
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Let 


Q{x) = [ -^^=dt{x>0), 

J X V ^ ^ 


g{u) = ( 5 ( 2 coshM — 2 ), 


and 

/ OO 

-OO 

Then one also has the spectral expansion for the kernel 


(5) 


OO 

K[z,w) = ^ h{rn)4'n{z)(j)n{w), 

n=0 


where = |; + is the eigenvalue for (/>„. Both of these expansions for K{x,y) 
converge absolutely and uniformly. 

The relative trace formula we consider here is the identity of the geometric and 
spectral expansions of 


/ / K{x,y)dxdy. 

Jc Jc 


Here, dx and dy denote the Poincare measure. The spectral side of the relative 
trace formula, i.e., the integral of (HI), is evidently 


( 6 ) J J K{x,y)dxdy = '^h{rn)\P{(j)n)\^. 

The geometric side, i.e. the integral of (jl]), is then 

p p _ pm^ pm^ 

/ / K(x,y)dxdy = 'S^ / / ■ ix,iy))d^xd^ y. 

JcJc Jl 


7Gr‘ 


Just as one breaks up the geometric side of the Selberg trace formula according 
to conjugacy classes, to get the geometric side of the relative trace formula in a 
suitable form, we will group the summands together by double cosets ro\r/ro. 
Fix a set of double coset representatives { 7 }. Write 


7 = 



Observe that 



f mna mn 
\rn~^nc m~^n~^d 


Hence each element of the double coset ToyTo can be written uniquely in the form 
7o77o for 70 ,7o £ Tq unless be = 0 or ad = 0. In the first case, we may assume 
7 = 1 . In the second, 7 is elliptic. However, X = r\i5 is smooth and of genus > 2. 
Hence T is strictly hyperbolic and does not contain any elliptic elements. (This is 
done for simplicity. If T indeed contains an elliptic element, the contribution to the 
trace formula will be the same as that coming from the identity.) As in |13j . we 
will call 7 regular if abed 7 ^ 0 . 
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Thus we may write the geometric side as 
T / / ^{u{jo ■ ix,iy))d''xd''y + 

7o6ro-^i -^1 

T / / ^{u{'yjo-ix,jo-iy))d''xd^y = 

7Gro\r/ro-ro7o.7iero“'i 

poo pm? _ poo poo 

/ / ^{u{ix,iy))d^xd^y -\- ■ ix,iy))d^xd^y. 

do ^gro\r/ro-ro 

Thus the geometric side of the relative trace formula is 

K{x,y)dxdy= ^ /^($) 

7Gro\r/ro 


C JC 


where 


and 


n m^ 

^{u{ix,iy))d^xd^y 

n oo 

$(t 6(7 • ix, iy))d^ xd^ y 


10 JO 

for 7 regular. The expressions sometimes called (relative) orbital integrals 

in analogy with the Selberg trace formula case. We now proceed to analyze these 
orbital integrals. 

2.2. The main term. For the kernel of principal interest to us here, the term 
/id(d>) will asymptotically dominate the other geometric terms, and thus we will 
call /id(‘b) the main term. To compute it, observe that 


/*oo /*m 


$(--2+^1 d^xd^y, 

\y x' 


poo pm 

Iidi^)= / / ^{u{ix,iy))d^xd^y 

Jo Ji 

which, by the change of variables ^ v = xy^ is 

poo pm^ poo 

/ / u~^ — 2)d^ud^v = 2\ogm / ^{uu~^ — 2)d^u. 

Jo Ji Jo 

It will be helpful to rewrite this by symmetry as 

/ oo 

<f>(u + u~^ — 2)d^u. 

Making the change of variables x = u + u~^ one finds that dx = {u — u~^)d^u = 
{2u — x)d^u. Solving for u, we have u = x + — 4 so d^u = — 4)~^/‘^dx. 

Hence we can rewrite the above as the integral 

$(x — 2)dx 


Iid{^) = 41ogm J 


(7) ■ 

Observe that, whereas as the main term of the Selberg trace formula involves 
vol(X), the main term of our relative trace formula involves len(C') = 21ogm. 
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2.3. The regular terms. A regular term {abed ^ 0) on the geometric side of the 
trace formula is then 


/^(<I>) = 


$(u (7 • icc, iy))d^xd^ y. 


This depends only on the double coset representative of 7 . 
Write 


a b\ 
c d) ' 


First observe that 


^ ■ IX = 


acx^ +bd + ix 
c^x^ + d? 


1(7 • ix,iy) = 


[acx"^ + bdY + (a; — y{c^x^ + d^)Y 
xy{c^x‘^ + 


Then one may check that 


{aox"^ + bd^) + x"^ n 9 ,9 


+ d? 

Plugging this in and expanding out terms gives 

ax'^ + b'^ y{c^x‘^ + d‘^) 


t-{l-ix,iy) = 


y xy X 


Making the substitution z = x/y and w = xy gives 

-| pOO pOO 

/^($) = - / / ^[a^z-\-(fz~'^-\-b‘^w~'^-\-c^w-2]d^zd^w 

2 Jo Jo 

pOO pOO 

= 2 / ^[a'^z + d'^z~^ + b‘^w~^ + c^w — 2]d^ zd^w, 

J\b/c\ J\d/a\ 

where the inner integral is over z here. This last step follows from the observations 
that the integrand and Haar measures are invariant under the substitutions z 1 —>■ 
d^/(a^z) and w !->■ b‘^/{c^w), and that z = (i^/(a^z) and w = b‘^/{c^w) when 
z = |d/a| and w = \b/c\. The purpose of making the lower limit of integration 
non-zero is to do the following change of variables. 

Observe that by making appropriate substitutions, 


fs rlogs 

/ f {ax + bx~^ + c)d^ x = / f{ae* + be~* + c)dt 

Jr J log r 

Jar+b/r V- 4:ab 


Applying this observation to change the variables z and w to u and v, we have 


pOO pOO 

(10) I^{^)= / ^u + v-2] 

J2\bc\ J2\ad\ 


— {2adY \/v^ — (26c)2 
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(The inner integral is over u and the outer over v.) This integral is indeed inde¬ 
pendent of the choice of double coset representative 7 as the quantities ad and be 
are. 

Now one can try to separate variables. Writing a = 2\ad\ and jd = 2\bc\ and 
using the substitution t = u + v, we get 


pOO pt 

/^($) = / <i>{t-2)dt / 

J a-\-l3 J ot 


du 


/a+f3 Ja \/{u^ — Op‘){{t — u)^ - 

Note that the inner integral over u is a elliptic integral—precisely, it is 


( 11 ) 


-{a- HY 


zK 


It^ - (a + /3)2 
— {a — PY 


where K denotes the complete elliptic integral of the first kindQ Let us consider m 
in two cases. Since ad—be = 1, ad> be. If ad > be > 0, then a — /3 = 2{ad—be) = 2. 
If 0 > ad > be, then a — (3 = 2{—ad -I- be) = —2. Thus, in either case, i.e. if 
abed > 0, then (a — /3)^ = 4. On the other hand, if ad > 0 > be, i.e. if abed < 0, 
then a + P = 2{ad—be) = 2. We also see that if |a±/3| = 2, then a=F/3 = 2|ad-|-6c|. 

Hence writing 5 = 5{"f) = 2\ad + be\ gives 


when abed > 0 and 


P{<^)=2£ 


$(t-2) 
— 4 


K 


$(t-2) 


K 


-4 


/t2_4 

t 2 -d 2 


dt 


dt 


for abed < 0. Observe that these integrals are indeed well defined as d > 2 when 
abed > 0 and 6 < 2 when abed <0. It will be seen later that there are only 
finitely many representatives 7 with abed < 0 , thus we will call these cosets and 
their representatives exceptional. 

In summary, we have the following result. 

Proposition 1. (Relative trace formula) For a function <i> as before, 

4>(t- 2 ) 


(12) 21en(C) 




dt 


+ 2 E 

5 ( 7 )< 2 " 

+ 2 E 

5 ( 7 )> 2 ‘ 


$(t- 2) 



d ( r „)| P (,(.„)|2 


In the sums on the left, 7 runs over representatives for the nontrivial double cosets 

ToWTo-To. 


^All non-elementary integral formulas used in this text may be found in [8]. 
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We have proven all of this except the explicit calculation of the first term on the 
spectral side. But this is easy, since Ao = 0 and is constant. We also used the 
Gauss-Bonnet theorem to give the volume of X explicitly. 

2.4. Geometry of geometric terms. In Proposition [T] the integrals /7(4>) were 
written solely in terms of $ and the quantity 6 = 21 ad-I- 5c |, which we now proceed 
to interpret geometrically. 

5^ 


Lemma 1. Let 7 = 


€ PSL 2 (M), and assume abed 7 ^ 0. Then 


inf { 11(7 • ix,iy) : x,y G 



if abed < 0 , 
if abed > 0 . 


Thus, for any 7 € PSL 2 (K), 

max {2, 5 ( 7 )} = 2 cosh(dist (7 • iR'*", zK'*')). 

Proof. Let us define a function of two variables, 

a^x 5^ 2 72 y 

h(x, y) = uH ■ ix, iy) =- 1 - \- c xy + d - 2 , 

y xy x 

by dH). We are interested in the minimum of h, so we need to compute the gradient. 
One obtains 

(13) hx{x,y)=0 x'^ = 


^2y2 . 


d2- 


Plugging this expression for x into hy{x,y) = 0 leads to the values 




:) 2 ' 

Now we consider different cases. If abed < 0, then set j/min = \J Then 
+ = 0- Hence with Xmin = 2/min/(c^2/min + ^^)> one gets h{Xmin, 2/min) = 0. 

On the other hand, if abed > 0, then set ymin = so that aeyX^ + bd = 2bd. 
Using m to define a;min 7 one obtains that 


h{i 


min 5 ymin 


f) = 2\/l -f 4:abed — 2 = 2|ad -I- 5c| — 2. 


Moreover, (ccmin? 2/min) minimizes h because as either x or y approach either 0 from 
above or 00 , h{x,y) goes to 00 . More precisely, there exist constants C,M G ]R>o 
such that for all N' > M and for all {x,y) ^ [ 1 /fV, fV]^, h{x,y) > C ■ N. We omit 
the details. □ 


There are two kinds of regular elements 7 : the exceptional 7 with 6 < 2 (i.e., 
abed < 0), and non-exceptional 7 with 5 > 2 (i.e., abed > 0). Observe that 
dist (7 • zR'*', zR+) is the same as the distance between the image of zR’*' and 7 • zR’*' 
in the “tube domain” rn\l 4 (so these curves in the tube domain intersect if and 
only if 7 is exceptional) □ 

One may interpret this distance on the base manifold X = M as follows. Con¬ 
sider the set of relative homotopy classes of curves on X whose endpoints lie on 
C. By this, we mean two such curves are equivalent if they are homotopic to each 


^We use the term “tube domain” here as it is suggestive of the geometry of the intermediary 
quotient FoXii, and not in the sense of a Siegel domain. 
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other by homotopies which vary the endpoints smoothly on C. In each relative 
homotopy class, there is a unique arc of minimal length, and this length will be 
the distance between and some 7 • iR'*' in the tube domain. Moreover these 
minimal lengths arcs are precisely the geodesic segments which start and end on 
C, meeting C orthogonally at each endpoint. Hence the non-exceptional regular 7 
parametrize the curves a-y in orthonormal spectrum of C, and the quantities (5(7) 
measure their length. Precisely, 

(14) ^( 7 ) = 2 cosh(len(Q;.^)). 

As for the exceptional terms, by considering the tube domain one sees that they 
correspond to points of self-intersection on the closed geodesic C. In other words, 
exceptional double cosets exist if and only if C is not simple. Note that any closed 
geodesic has at most a finite number of self-intersections, so that there are only 
finitely many exceptional terms. This follows from compactness of X, and is also 
a consequence of a lattice point counting argument in the next section. 

For 7 exceptional, (5(7) determines the angle 9 of self-intersection at the point 
corresponding to the double coset of 7. For example, the intersection is transverse 
if and only if (5(7) = 0 . Specifically, from ([8]) we see that the line 7 • intersects 
when acx'^ + be = 0, i.e., at the point 

I —ab 

Since 7 • is a Euclidean semicircle in ^ with center (ad -I- bc)/{2cd) we compute 
that the radial line from this center to iy has slope 

2\/—abcd \/4 — ( 5 ^ 
ad + be ±(5 

Hence it follows that 

( 15 ) 5 =\2 cosd|. 

In summary, we see that the relative trace formula encodes three pieces of geo¬ 
metric information, the length of C coming from the main term, the self-intersection 
angles of C coming from the exceptional terms, and the ortholength spectrum com¬ 
ing from the remaining regular terms. Thus we may think of this trace formula as 
a relation between the ortholength spectrum and the orthogonal spectrum. 


3. The exponential kernel 


In light of the elliptic integrals in (IT^ . in order to compute the integrals / 7 ( 4 >) 
in a specific case, one might want instead to separate the integrals in (fTP)) . This is 
possible if we choose our kernel function to be 

$(a;) = 


Here we take t > 0, which makes <1? of rapid decay, and thus it is a valid test function 
for our relative trace formula. Then we get from (HOD 


roo tuj i-oa tv J 

/^($) = ^ ^ . 

A|ad| - (2ad)2 J 2 \bc\ - (26c)2 



Ko{at) 


Note that, for a > 0, 
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where Ki, denotes the if-Bessel function. Hence 

/ 7 d($) = 21 en(C) e^^Koi2t) 

and 

/^($) = e^^Koi2\ad\t)Ko(2\bc\t). 

Note that ad = and be = , hence 2\ad\ and 2|5c| equal, in some order, 


and 


| 5 - 2 | 


Thus the geometric side of the relative trace formula is 
2len{C)e^^Ko{2t) + ^ e^^Ko 

where <5 = (5 ( 7 ) and 7 runs over a set of representatives for the nontrivial double 
cosets of r by Tq. The following asymptotic is standard, and may be found in [5] 
along with other facts about Bessel functions we use later: 


(16) 


Ko{t) ^ \ j * as t —>■ 00 . 


Hence as t —>■ 00 , the main term looks like 


(17) 


Jzd($)^len(C)J-, 


the exceptional terms grow like 
(18) /^($) 

and the regular terms grow like 
(19) /^($) 




— 4 

Now consider at the spectral side. We have 


Q{v) = 


f dx = / x-^/‘^e-*^dx = 

Vx -V Jq 


Then 


h{r)=J Q{2coshx-2)e"=^dx = e'^^^ j = 2e^^ ^ K , r { 2t ). 


For t > 1 + , we have 




From (|n]) the spectral side of the relative trace formula is 

00 j— 00 

h{rn)\P{K)\^ = 2e^^J ^ ^ K,rA2t)\P{cj)n)f. 

n—0 ' n 


n—0 


In summary, we have the following. 

Proposition 2. (Relative trace formula — exponential kernel) 

( 20 ) 

21en(C)e"‘iFo(2t)+^e2‘iFo ^0 = 2e"‘-y/^X] if,.„(2t)|P((^„)| 
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We remark that the arguments ivn of the Bessel functions Kir^(2t) appearing 
on the right are real for exceptional eigenvalues A„ < | and purely imaginary for 

An > 4- 

Proposition 3. As t —>■ oo, we have the asymptotic 


(21) 2e2* =len(C),/|+(^ 

’ n=0 ' \5<2 

or, in a less refined form, 

OO 

(22) \im e*y^K,rAt)\P{cj)r^)f = 

f.—^OO 


-+0 


V4 — (5^ j t ’ 

len(C') 


n—1 


Proof. We first consider the non-exceptional regular geometric terms /^.(d*). For t 
large, we have the estimate 


(23) 






Hence for t large, we may make the estimate 


/^($) = e^^Ko 


S + 2 


t K, 


|<5-2| 


= -i(<5-2) 


t < 


1 + 


1 


2((52 - 4)t 16(52 - 4)t2 J ■ 


tVs^^ 

To estimate J2-y need to know some bound on the growth of 6. We 

can estimate a count 

T^six) = #{7 G ro\r/ro - Fq : 5(7) < x} 
from the lattice point problem. The principal result we will use is that 

G F ■. of -\-+ (? + < ccl = 0{x) 


# 


a b 
c d 


(e.g.. Theorem 12.1 of [E].) We can count our set as 
'a b 


T^six) = # 


c d 


G F — Fq : 1 < |a| < m, 1 < |6| < 2\ad + bc\ < x > . 


Elements in this set satisfy 

x^ 

+ d^ + 2abcd < {ad + bc)^ < 

If abed > 0 we clearly have + d"^ < Suppose abed < 0. Then ad > 0 > be but 
since ad = 1 + 6c, 0 > 6c > — 1 and so abed > — 1. Hence in either case we have 

^2 


SO 


+ d < -r + 1, 


G F : a^ + 6^ + c^ + d^ < 2m^ + “T + ^ f “ O(x^). 


Trs{x) < # 

Let {5„} denote the sequence of 5(7)’s in increasing order. Then for any e > 0, 
71,5(x) = O(x^) implies 


(24) 


Sn > n2+'. 


We remark that this also implies there are only finitely many S < 2, i.e., only 
finitely many exceptional double cosets with abed < 0, as noted in Section 
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Now we may uniformly bound 


/^($) < C 


— 4 


for some C > 0 and t large. Also, since the sum of any finite number of goes 

to 0 exponentially fast as t —>■ oo, it suffices to bound the growth of some tail 


S>N S>N 


ire 


-t{S-2) 






,1/3 


n>N' 




Here we have used (1^^ with e = 1. We can easily estimate this sum on the right 
by 


E 

n>N 


ire 


0 . 1/3 




/ oo g_txl/3 ^OO 

—~ J ue~*^du = 37re“* (t~^ + . 


Hence the contribution from the non-exceptional regular terms is 


E^7W=0 

S>2 


j-(5o-2)t 

t 


where Sg is the minimum S > 2, which will be absorbed in the error terms below. 

On the other hand, we may estimate any of the finitely many exceptional terms 
by (HU), and observe that (1^51) gives 0(t for the error term. Similarly there is 
an error term coming from the main term estimate (HU. Putting these 

estimates in the relative trace formula yields the first assertion of Proposition [3l 
and the second follows from identifying dominant terms. □ 


Combining the asymptotics (ITH)) and (l22ll yields the following 
Corollary 1. P{4’n) 7^ 0 for infinitely many n. 


4. Refined estimates 

In this section, we will use z for a positive variable. We will need uniform 
asymptotics of the AT-Bessel function as well as many other estimates to apply a 
Tauberian theorem to conclude the main result of this section, Theorem [5] below. 

4.1. Uniform AT-Bessel estimates. In what follows, we will be interested in 
asymptotics and estimates for 

(25) K„{z) = ]^ 
as both of the parameters r and z vary. 

In the above, r and z are both real, with z > 0. Notice, under the transformation 
t CA —t, the integral above is automatically real. 

We first will be interested in the case 4 < r < z. 

Let us make the change of variables 

(26) cosht — 1 = ; s • t > 0. 

The above restriction forces s < 0 when t < 0, and similarly s > 0 when t > 0. One 
can see this change of variables is a diffeomorphism from R. -o- M, and we can write 
t as a function of s as t{s) = cosh“^(s^ + 1), for s > 0 by equation (l26ll . With no 
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restriction on s, explicitly, t{s) = ln(l + + s^/s^~+^). The differential can easily 

be computed: 

(27) ^ = ,, ^ s e R. 

It follows that 


ds + 2 

Kir{z) = —— / 

'J M 

Lemma 2. For r > 0 and z > 0, we have 
d^ir{z^) — 


^-zs ^irt{s) 




^/i^T2 


ds. 


ds H- —O 


■ vr 


\/s2 + 2 \/i V\/^ 




Notice that to really use this, r must be smaller than z by a power of z; the 
region 4 < r < will be of interest later. The error constant here is uniform. 

Proof. In light of the expression following equation (1271) , we need only show 




\/i2T2 


ds 


J(-oo,-^]U[^,oo) 

can be absorbed into the error term. This is trivially bounded by 


4e 


ds = 


4e 






du < 


4e 


-\/^U 




du. 


The equality above is from a substitution, and the inequality uses the region of 
integration. We have with u S [^,oo) (we will use a similar estimate 

in Lemma HI). This last integral is trivially evaluated to be and the lemma 

follows. □ 

We must now estimate t{s) which appears inside the s-integral, in Lemma H] 

By (l?7l) , we can write the Maclaurin series for (respectively) ^ and t as 


(28) 


dt 


ds - "^[1 “ 3 ®^ + + 


(29) 


^t(s) = \/2[s - -]. 

Convergence is uniform for both series, for |s| < \f2. In what follows, we will be 
taking |s| < as well as assuming r > 4. With these assumptions, we easily have 

f = v/2[I-is2]+0(s4) 
t{s) — y/2s = + 0(s®) = O(s^), 

with uniform constants in all error terms, since s € [—l/-v/r, l/i/r] C [—1/2,1/2]. 

Now we can replace the term in equation (I25p with cos(rt(s)). From a 

simple calculus theorem, we have 

cos(rt(s)) = cos(\/2rs) — r{t{s) — V2s) ■ sin(rc(s)) 

where c(s) is a point between t{s) and s. With our assumptions on r and s, this 
gives 

(30) cos(rt(s)) = cos(-\/2rs) + O(rs^) 
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using equation (l 2 ^ along with the trivial estimate |sin(rc(s))| < 1 , again with 
uniform constant. 

Thus, the integral term in Lemma [5] we can now write as 


— / 

(31) J I ^cos(-\/27rs) + 0(rs^)^ ^[1 — + 0 ( 5 "^)^ ds 

^cos(-\/ 2 zrs)[l — + Oirs^ + ds. 

Here the constants in the error term on the right are uniform, but also depend on 
the constants in the O terms on the left coming from equations (l29l) and (l30l) . 

Essentially, after noticing the cosine term in the integral on the right hand side 
of equation (jSTll can be replaced with an exponential, these computations give 



Lemma 3. For 4 < r < z we have 


K„{z) - ^ ^ 




^ — zs^ ^\/2irs 

e e 




[1 — ds 
4 




Proof. Following the Taylor estimates on t{s) and ^ after Lemma [2] (as well as 
using Lemma [2]) all the way to equation (IMT) , we see the main term above is the 
integral on the right side of (EH). Thus, all we need to show is that the error terms 
from the right side of EH account for the first term inside the error term above. 

Easily, one error term from the right side of EH is 


e-^-O 




This can trivially be bounded by 



The first equality is a substitution. The second is extending the integral to half the 
real line (so the interval is independent of r or z). This last integral converges, but 
we will have to incorporate its value into the error term of this lemma. 

The other error term produces which we simply absorb into the 

( 7372 ) term by our assumption 4 < r < z. □ 


This leads us naturally to 
Lemma 4. For 4 < r < z we have 


K„{z) - ^ 


g-zs^g\/2irs 


Note; the constant here is uniform, but possibly different than previous lemmas. 


[1 + ^o(-^ + ^e- 
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Proof. By Lemma [H we need to estimate 

poo -I 




ds < e 


vT 




ds. 


By a change of variable, the right side here is now equal to 




4:Z' 


du. 


By estimates very similar to Lemma [21 as well as an integration by parts, this can 
be shown to be of the size where the uniform constant is actually 

different than that of Lemma [2] The only error term in this lemma unaccounted 
for comes from the error term from Lemma |3l □ 


We will evaluate the integral in Lemma [4] by using Fourier transforms. 

Suppose f{x) is a Schwartz function on R. We define the Fourier transform of 
/ as 

Ky) = [ /(a;)e“^ dx. 

Jr 

Since / is a Schwartz function, / also is. Furthermore, 

^(y) = f fix) ■ dx ^ = - [ f{x) ■ x^e-y dx. 

dy Jr d-^y Jr 

Note that with our normalization the Fourier transform of the Gaussian function 
f{x) = is 

(32) f{y) = [ dx = . 

Jr 

This brings us easily to 


Proposition 4. For 4 < r < z, we have 

1 


K„iz) = 




r'^ - z 


8z2 


rO 




-v/i 


Proof. We use Lemma|3]along with the above Fourier theory to compute the integral 
of LemmajH exactly. Consequently, the error term here is also exactly that of Lemma 

111 

By the change of variable x = \/zs, the integral in Lemma [4] becomes 



2 f7y 

So, one term here is exactly the Fourier transform of , evaluated at y = 
Applying equation (1321) to this first term, as well as the term involving the x^ (which 
brings a second y-derivative of ^/Tre~r ~) gives our result. □ 

(Note: If we fix r and send z to oo we recover the asymptotic which is 

valid for any fixed r by Laplace’s method. This proposition gives us an asymptotic 
for z, but is also uniform for r of size even much larger than ^/z. For example, one 
will see that the r values in the region y/z < r < y/z log(z) will still contribute to 
the sum (l22ll .l 
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Proposition 5. For z sufficiently large, and 225 < r < z, we have 





Proof. With our assumptions on r and z, integrate by-parts 

2K„{z)= [ 

Jr 


15 times. Note that z must be very large here. 

5/2 

Specifically, as a smaller example we will show Kir[z) = e~^0{^—^) after 5 
integrations by-parts. We have 


(33) 

where 

(34) 

^ -zcosht 

dt^ 


2K„{z) 


-1 

ir^ 


dt^ 


g —z cosh t 


dt, 


f—sinh^(t) -I- 10z‘*sinh^(t) cosh(t) — 25^^ smh^(t)'l 
\ -|-15z^ sinh(t) cosh(t) — 0(15z^-I-1) sinh(t) J ^ 


Our strategy for obtaining an estimate at 15 integrations is the same for 5, which 
we explain now. 

Now, we replace (IMl) . which has 5 terms, into the integral of (1551) . and then 
separate to make 5 integrals. We obtain an estimate for the size of each integral. 
For example, if we take the second term on the right side of (l34l) . we become 
interested in the size of the integral 

4 p 

(35) ^ / [sinh3(t)cosh(t)e-^™'^*'‘] 

Js. 

Let us take a closer look at the function sinh^(t) cosh(<)e“^“®^‘ appearing in 
dSSl). For convenience, in this proposition, let us use h^ft) = sinh^(t) cosh(t)e 
For each z, hz{t) is odd. Its derivative is 

(36) g-zcosht smh^{t)[-zsmh‘^{t) cosh(t) + A sinh^{t) + 3 ], 


which is clearly zero at t = 0. The term in brackets has only one zero for t > 0 
(recall, z is very large). This happens when 

4 3 

cosh(t) sinh^(t) cosh(t) 

Using the Maclaurin series for both sinh(t) and cosh(t),we find this zero happens 
at a value of t that is of order l/\/i- In other words, for z sufficiently large, we 
have the other zero (for t > 0) of the derivative (l36l) occurs at some to{z) with 

(37) to{z) ^ 

Consequently, hz(f) = sinh^(<) cosh(t)e“^“®^* is strictly increasing (resp. decreas¬ 
ing) on (0,to('2^)) (resp. (to(z),oo)). Now, since this function is odd, we are in¬ 
tegrating hz{f) against sin(rt) in (I35L which has period 27r/r. We will break up 
each interval where hz{t) = sinh^(t) cosh(t)e“^'^°®^‘ is monotone into segments of 
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length 7r/r with endpoints feir/r, fc G Z. More specifically, put ni{z) G N be the 
first (smallest) integer so that ni{z)Trlr > to(z). Then 


/to(z) 


sinh^(t) cosh(t)e 


—z cosh t 


sin(rt) dt 


pni{z)'7T f r p{k-\-l)TT/r 

/ hz{t) sm{rt) dt + ^ / hz{t)sm{rt) dt 

Ito(z) 


ni{z)-n'lr 


rniiz 

Jto{z) 


hz{t) sin(rt) dt + 


k—ni {z) 


with the obvious definition for ak- Since hz{t) = sinh^(<) cosh(t)e is strictly 

decreasing on [to(-z)) oo), we see that the series J 2 T=ni{z) is an alternating series 
where |afc+i| < |afc|. Consequently, the sum of this series is in absolute value 
^ l®ni(2)|- 

How big can |a„^( 2 )| be? We are integrating over an interval of length n/r. 
Further, the maximum of the integrand must be, using dSIl) , at most 


This gives us a total of O (^ ^^ 3/2 ^ • The integral 

pni {z)'K jr 

/ sinh^(t) cosh(t)e“^™®''‘sin(rt) dt 

J to(z) 

is handled similarly (the interval is shorter than n/r). 

This leaves us with 

a) 

sinh^(t) cosh(<)e“^“®*'* sin(rt) dt. 

By our assumption on r and z, namely that < r, this implies that 2n/r 

(the period of the oscillating factor) is much less than tQ{z). Consequently, we 
can do the same type of analysis for the interval (0,to(-2^)), and actually conclude 
the same result. Here, we will have a finite alternating sequence, whose absolute 
value terms are increasing. This means we use the last term for estimates; this 
brings us to an interval [{ni{z) — l)7r/r, ^ 0 ( 2 )], and once again we use that hz(t) = 
sinh^(t) cosh(t)e“^“®^* sin(rt) has a maximum at to{z). For t < 0, we just use 
symmetry; sinh^(t) cosh(t)e“^“®*'* sin(rt) is an even function of t for any z. We 
conclude the same result, and leave the details to the reader. 

This gives us the contribution of the hz{t) = sinh^(t) cosh(t)e“^“®*'* term from 
(IMl) into (IM)l is This bound holds for each of the 5 pieces (IM)) . Con- 

sequently by (j33p . we have Kir{z) = with our assumptions on r and z. 

We see from computation that each integration by parts gives us an extra factor 
of y/z/r, keeping our assumptions on r and z. Integrating by parts 10 more times, 
this gives the proposition, since we have a factor of \fz.lr each time. □ 



We remark that if one restricts to special regions, one has better estimates for 
the iF-Bessel functions than those in Propositions |4] and [3 but the contributions 
from these regions are negligible for our asymptotics. 
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4.2. An eigenvalue moment estimate. In this subsection, we record estimates 
needed for our main theorem below. 


Lemma 5. Let a G R with a ^ —2. Let mi,m 2 > 0 with m 2 > mi. Then 


lim y = O ( 

2—foo ^^ -I V 

Further, if a > —2, 

^lirn y r“ = . 

4<r3<z”*i 


Proof. First, let us define the function N{x) to be the total number of eigenvalues 
Xj with Xj < X. Clearly, we are taking a: > 0, and we are counting eigenvalues with 
multiplicity. For our situation, it is well-known that Weyl’s law holds ([ID], [12)1. 
i.e., 


(38) 


N{x) 


TOi(r\H) 

Att 


X as X 


Further, let us note that since Xj = j+rTwe have 


(39) rj ^ \/^ 

with uniform constants, since we will always be considering only rj > 4. By (I38L 
we also have 


(40) N{x) < cix = 0(x) X > 1, 

for a universal constant Ci. We will only need to consider Xj > ^ in the future for 
estimates. 

Let us consider 

lim y r“. 

z—>00 ■' 

Z™1 <rj<z’^2 

Since mi > 0, and we are taking z to 00 , we may assume > 4, so that the 
statements in the above paragraph hold. For z large, by (I5D|) notice that 


E 

zmi <r^.<z™2 


- E 



Z™1 <J'j<z”*2 


with universal constants depending on mi, m 2 , and a, but not on z. Now 


E 

2"*i <rj<z’^2 


y 



r- 2 + 1/4 

1 - 1 - 1/4 




dN{x). 


By partial integration, this equals 

22^2+1/4 


"/27V(a 


1 + 1/4 


a 

2 


2+1/4 


'z2Tni_|_l/4 


a; 2 ^N{x) dx. 


Using Equation (1401) for both terms here, along with simple estimates, gives the first 
part of this lemma, where the O constant is allowed to depend on a. If a > —2, the 
m 2 term will dominate, while if a < —2, the mi term will dominate. The second 
part of this lemma is proved the same way. □ 
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4.3. The main result. Using the estimates we have developed, we can now prove 
Theorem 1. With notation as above, 


(41) 


!— OO 

hm 




1=0 


= ^len(C). 


Proof. Once again, consider the sum in Equation ([22]), i.e., 
(42) 

3 



There are a finite number of terms in the sum here, with Vj < 4. For each of 
these terms, one has a limit of as z —i oo from Laplace’s method. A result 

of Reznikov [22] gives 

£ = 0(A]/"), 

and so by Cauchy-Schwartz, 


(43) 



= o ( Ay ^). 


1 /2 

This bound will be important for us. Note that the trivial L°° bound, 0(A^' ), is 
not sufficient for our purposes. (In fact, Zelditch [28l Corollary 3.3] showed that 
the periods | (pj \ are bounded by a constant, but his argument essentially makes 
use of what we are trying to prove.) 

In particular, the sum of the finite number of terms in (1421) for which Vj < 4 can 
be bounded by 


e^-0 



= O 


/A^ (65/4) A 


— 1 0 as z —>■ OO. 


Consequently, we will separate the sum in equation (l42l) into four separate re¬ 
gions. These regions will be: 4 < r < y/z, yfz < r < t < z, and 

r > z. We will prove each bound, in a separate proposition, one for each region. 


Proposition 6. 


lim 

Z—¥00 


e^ ^ 

4:<rj<y/z 



2 


lim 

2^00 



2 



■^<rj<y/z 



Proof. In light of the error terms from Proposition 0] as well as Reznikov’s bound 
(l43l) . it is sufficient to show 


E 

4<rj <-^2 



|r| - z| 


- 5/2 




—I 0 as z —I OO. 


By our assumptions on rj and z here, we have incorporated the error term 

into the error term (inside the O term of Proposition 0]) using simple log 

estimates. 
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If we use the trivial bound of 1 for the exponential term, as well as |r| — zj < z, 
then the uniform asymptotic ([39)l gives the term above is 

fZ+l/4 ^1/4 y3/4 \ 



,3/2 


dN(A) 


This can be shown to be 0(1/-^) using Lemma [5j Specifically, this term can be 
split into two integrals, which both arise by estimating sums from Lemma [Sj the 
first with a = 1/2, the second with a = 3/2, and both with mi = 1/2. □ 


Proposition 7. 


lim 




•\/2<rj<z'^ 


= lim 
2^00 


v/2i 


E ' 

\/z<rj <2"^ 


Proof. As in the previous proposition, the assumptions on rj and z in the sum of 
this proposition let us absorb the term into the error term (again, 

inside the O term of Proposition 14]) . 

From the error terms in Proposition |4] and Reznikov’s bound (1431) . it is sufficient 
to show 


E 

^ M 

y/zKrj <2 25 






—>■ 0 as z —>■ oo. 


In this region, > z and so |r| — z| < Consequently, we need to estimate 


E 

^ I'l 





which is (uniformly) asymptotic to 


28/25_|_j^y4 1 .228/25 ^j^^4 

^ dN{\) + ^ / dN{X). 

z Jz+l/4 ^ ^ J 2 +I /4 


+ 1/4 


by ([39)l . (Note there are no issues, such as uniform constants, with asymptotics 
here, since an asymptotic was not used in the exponential factor.) The first integral 
here can be shown to be 0(1/ ^-^), using Lemma [SJ with a = mi = 1/2 and 
m 2 = 14/25. Hence this term dies off. 

The second integral is not quite as easy in this region, and we will need to use 
the exponential term. First, since we are sending z —>■ 00 , we can ignore the 
term. An integration by parts of this integral gives 


1 


e-^X^/‘^N{X) 

,, 28 / 25 ^ 4/4 ^^ 28/25 + 1/4 

+ / e-^Ai/4 

l^-5/4 

1 - 


2+1/4 Jz+l/4 

^2z 



Using llQl), the first term here is z • + -(-2;(4 +i)) which clearly 

dies as z —>■ 00 . Using the uniform bound N{x) < cix from (liOl) the second term 
can be seen to be trivially bounded by 


Cl 

z5/2 


rz28/25_|_l/4 


/ 2+1/4 






dX. 
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With the change of variables x = -, this term becomes 


9/4 

, 5/2 


^3/25 ,J^ 


+ 47 




'i+i 


L2 


+ 5/4 


dx. 


Now, the same integral taken over [l,oo) converges, and this yields the bound of 

0 ( 1 /^). □ 


Proposition 8. With notation as above, 


(44) 0 = lim e"" Kir, {z) 


<ri<z 


<C 


= lim ^ 

<r,<z 


e 2 * 


Even though we are dealing with zero here, we will need the form of the summand 
of the right side to apply a Tauberian theorem later. 


m- 


Proof. By Proposition [5l for rj and z as such, we have Kir{z) = e ^ ■ O 

Using (|43)) . the left hand side of (l44l) can be bounded by (up to an error, or rather 
an O constant) 


/ 


lim 

Z—^CO 


+5/2 . 


E 


A 


1/4 


V 


„16 

j 


Since \/^ rj, the sum here is exactly that of Lemma [S] with a = —31/2, 
mi = 14/25, and m 2 = 1. Using the bounds of LemmaOthe above can be seen to 
be 0(z“^/®°). 

Using Reznikov’s bound (|i51) . the right hand side of (HU) can be seen to be 
bounded by 


\/7r/2 lim 

^—>•00 y z 


1/82 ^ 2 '^ + 1/4 


e-^A^/'* dN{X). 


f 2;28/25_|_]^y'4 

This integral is very similar to one occurring in Proposition [7l and we evaluate 
it the same way with the same substitution. We see the first term dies under 
integration by parts. Using N(x) < cia;, we are left with two terms inside the 
integral. Estimating trivially (again with the substitution x = ^) we need to 
bound 

fz+l/4z 

g-x/2^2 

/,3/25_|_l/4, 

(Here we have used 2x^ > x^^'^ Px^!^ to simplify the integrand after an integration 
by parts; recall we are sending z —> 00 , so this estimate is trivial in the above 
region.) Extending the integration domain to 00 ), two integrations by parts 

3 A 


2ciz3/4 r 
Jz3 


give us 0(ciZ4 + 25e We clearly win due to the exponential term. 

This leaves us with the simplest case: 


□ 


Proposition 9. With notation as above, 

(45) 0 = lim {z) [ (fj 

2—>-00 


= lim 


\/2i 


E 


'C 
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Proof. We could indeed take care of this case, almost identically to Proposition [8] 
(with a similar comment as to the start of that proof), except for a rather technical 
piece that Lemma[5]only deals with finite sums. A simple modification can be made 
to handle the left side of (|45|) . However, in the region r > z it is much easier to see 
Kir{z) decays rapidly, than using integration by parts 15 times. If one integrates 
by parts once the integral representation for Kir{z) from 8.432, #5 of [8] on p. 917 
with X = 1, one sees that Kir{z) = 0(re“'2''), for r > z. This is clear using known 
r function estimates. The rate of decay is clearly better than e~^, for r > z. 
Further, we are summing over but this estimate is easy. 

The right side of (1^ can be handled almost identically to the right side of (l4^ . 
as in the proof of Proposition El We leave the details to the reader. □ 

These estimates prove the theorem. □ 


We now come to the main result of this section. 


Theorem 2. 

\P[4'n)\^ ^ ^—-Vx as X ^ oo. 

^ ' TT 

Aj <a: 


Proof. This follows easily from a powerful Tauberian theorem. 

Let us construct a measure H on [0, oo) by putting a point mass of (j)j\ at 
the point Xj. (If there is more than one eigenfunction (fj corresponding to Xj we 
must sum over all, for our point mass.) Then we can define the Laplace transform 
with respect to this measure as (notation as in Feller, vol. II [5]): 


^^iy) 



H {dx} = Y, • 
1=0 



2 


By dm, we see this is finite for each y > 0. 
Applying (HTl) with y = l/2x, we see that 


w(2/) 


e-y/4 


len(C) 

2v^ 


as 2 / —?> O'*'. 


The function e is essentially harmless, it is well behaved, and equal to 1 at 
y = 0. By Theorem 2 of Feller [51 p. 421], this gives us (with p = 1/2) 


u{t) = r 

Jo 


H {da;} 


len(C') 

20Fr(3/2) 


v/r as 


(This is the Tauberian theorem alluded to above.) 

By the definition of our measure, this gives us the asymptotic of the theorem. 


□ 


As mentioned in the introduction, a very weak bound on the error term imme¬ 
diately follows from a Tauberian remainder theorem, precisely m Theorem 3.1]. 
Notice that we can write the above Laplace transform asymptotic as 

, fix len(C) ^ 

F{u) = w --^ 

\UJ 2y/TT 

for u > 0, where the asymptotic is as u —>■ oo. 
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Since trivially = 1 + {e~i^ — 1), we see e{u) = 1 — e~^ using the notation 
in [TB]. Then the theorem cited above says that there exists Ci > 0, C 2 > 1 such 
that the error term is bounded by 


min 

fe>fco 



for some fco € N. 

By taking u sufficiently large and using k = ^ logp 2 (w), we see the error term is 
bounded by 

Cilen(C) ^ / Vu \ 
logc2(«)'^ VoguJ' 

With X sufficiently large and x = u, we see that our error term is at most this 
much. 


5. Twisted periods 


Twisted periods are important in the study of L-values as well as in various 
equidistribution problems. In this section, we show how to include twisting in the 
relative trace formula. 

First observe that for n S Z, 

x{x) = 

for a: S R defines a character on C = ro\jR''', by which we mean 


-1 = X(a^). 




is a character on the diagonal subgroup of PSL 2 (R) invariant under Tq. Now we 
consider two characters on C given by 

/ \ , ”“0 / N 

Xi[x) = a;, X2[x) = 

for some j, fc G Z. 

Now consider the relative trace formula obtained by integrating 


[ j K{x,y)xi{x)x2\y)dxdy. 

Jc Jc 


From the spectral expansion of the kernel, this clearly equals 

^{Xn)Pxi i4’n)Px2 i.4’n) 

where 

PxMn)= [ (t)n{t)Xi{t)dt. 

Jc 

On the other hand, the geometric expansion of the kernel gives as before 

E 


ro\r/ro 


where 


poo pm 

Iid{<^)=J J ^{u{ix,iy))xi{x)x2^{y)d^xd'^y 

poo poo 

^ 7 (^) = / / '^i.u{x-ix,iy))xii.x)x2^{y)d'^xd'^y 

Jo Jo 


and 
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for 7 regular. One could compute the geometric terms similar to before for an 
arbitrary but we will content ourselves to the case $(a;) = e~*^, t > 0. 

First let us compute the main term. Put fi = and A = Then the 

substitution u = ^ and v = xy yields 


j-oo 

hd{^) = J J + 

Note that the integral over 1 < z; < is 2 log m if /i 
is 


2 d^ud^v. 


= A, i.e. j = k] otherwise it 


2 

y — X 




1 ) 


21en(C) 

0 


We finish the main term computation similar 


if A: — j is odd 
if A: — j ^ 0 is even 
to the beginning of Section [3] to get 


/id($) 


" 2 len(C')e^‘iFA*+y (2A) 

(2t) 

.0 


if j = A: 

if A: — j is odd 

if A: — j 7 ^ 0 is even. 


We will say xi and X 2 have the same parity ii k — j is even, and have different 
parity \i k — j is odd. 

Note that since xi and X 2 are unitary, we may bound the regular geometric 
terms by 


E 

7/Id 


< 





(J- 

\ty/i 


as in Proposition [3l 
periods. 


These estimates immediately give several results on twisted 


5.1. A single twist. Our first result on twisted periods, is in the case of a single 
twist, i.e., suppose Xi = X 2 = X- Since K^{2t) and Ko{2t) have the same asymp¬ 
totics as t — >■ 00 independent of v, the asymptotics for /id(‘h) are the same as in 
Section [3l It follows as in just as in Proposition [3] that 

(46) ^hm 

n—1 

Then we observe that all of the estimates in Section |4] apply as before to yield 
Theorem 3. For any character x of C, 

'E \Pxi4’n)\'^ ^ ^— ^-\/xasx^oo. 

^' 77 

\j<X 

5.2. Different parity. Now suppose xi X 2 such that xi and X 2 have different 

parity. Then the main geometric term is on the asymptotic order of where 

as any individual spectral term is on the order of t~^. This implies we must have 
an infinitude of spectral terms. More precisely we have the following result. 

Proposition 10. If xi and X 2 have different parity, then for infinitely many (fn 
the periods and Px 2 i 4 >n) are simultaneously nonvanishing. 

We remark that one cannot use the estimates in Section 0] to estimate the growth 
of the product of these periods because the spectral terms are in general complex. 
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5 . 3 . Same parity. Finally suppose that yi and X2 differ but have the same parity. 
Then the geometric side is dominated by the exceptional terms. However, in the 
case that there are no exceptional terms, i.e. C is simple, the geometric side is 
q(^- 3/2)^ Again, we can contrast this with the order of an individual spectral term 
to show that infinitely many spectral terms are nonvanishing. 

Proposition 11. If C is simple and xi Xi have the same parity, then for infin¬ 
itely many (fn the periods Px. {(fn) and Px2{4>n) ore simultaneously nonvanishing. 


6. Pairs of geodesics 


Let Cl and C2 be distinct closed geodesics on X, which we take to be primitive 
for simplicity. We may assume Ci = ri\i]R+ and C2 = r2\T • for some t S 
PSL2(M), where, if A denotes the diagonal subgroup of PSL2(IR), Fi = ro = Anr 
and F2 = t~^At fl F. With the kernel function as before, we now proceed to 
consider the relative trace formula arising from the integration 

/ / K{x,y)dxdy. 

J C\ J C2 

In this case, for any 7 G F, the map onto the double coset r2 x Fi —>■ F27ri given by 
(72,71) '—>■ 72771 is injective, i.e., all double cosets are regular. Hence the geometric 
side of the trace formula is 

X! / / ■ x,y))dxdy = 

.../-•n Cl Co, \ /T^ 


7 er 


where 


Note that 


cm = 


$(u (7 • 


76r2\r/ri 


■iy))d^xd^y. 


On the other hand, the spectral side is evidently 

Yh{rn)Pl{(l>n)P2{4’n), 

where 

PiW = [ 4'{x)dx 

JCi 

for i = 1 , 2 . Then, in the same way we obtained Proposition [I] one obtains 

Proposition 12. (Relative trace formula for pairs of geodesics) For a function 
of sufficiently rapid decay, 


( 47 ) 





dt 


P -4 

00 

= Y h{rn)Pl{(j)n)P2{4>n). 


n—0 
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It is clear from Section El that 6 {t ^7) < 2 if and only if Ci intersects € 2 , 
in which case this quantity measures the angle of their intersection 0, specifically 
S = | 2 cos 0 |. Otherwise, 

2 < d(r“^7) = 2 cosh(dist(7 • iR'*', r • iK"*")). 

The quantity dist(7 • i]R+,T • i]R+)) may be interpreted on X as the length of a 
shortest geodesic segment 7 starting on Ci and ending on C2 orthogonal to both 
Cl and C2- Furthermore, all such 7 come from some 7 with > 2 . Thus the 

trace formula (l 47 l) expresses the angles of intersection of Ci and C2 and the lengths 
of these orthogonal geodesic connectors 7 in terms of periods of automorphic forms 
on Cl and C 2 - 

As in Section E specializing the above trace formula to the case where $(a:) = 
g-tx yjgijjg following. 

Proposition 13. (Relative trace formula for pairs of geodesics — exponential ker¬ 
nel) 

( 48 ) 

^ e^^Ko Ko (^t) = 2e^\f^^K„^{2t)Pi{cl>r,WK), 

76 r 2 \r/ri \ / \ / V 

where S = 

If we want an analogue of Proposition E we should estimate the number of 
double coset representatives 

= {76 r2\r/ri : d(T"^7) < x] . 

We are free to multiply 7 on the left by an element in r2 = tAt~^ fl T and on the 
right by an element of Ti = Tq in choose a set of representatives. Equivalently, 
we are allowed multiply t“^ 7 on the left and right by elements of Tq. Hence our 
counting argument to estimate tts{x) also applies to 'x'g{x) and the rest of the proof 
of Proposition E goes through to give 

Proposition 14. As t —> 00 , we have the asymptotic 

( 49 ) = ^ + . 

Note that any single term on the left hand side is on the order of Hence 

Corollary 2. Suppose Ci (1 C 2 = 0- Then Pi{4>n)P2{4>n) ^ 0 for infinitely many 
n. 


7 . Ortholengths 

7 . 1 . Coarse bounds. In this section we will consider taking t —)► O'*" in (Uni). We 
note that the right hand side of (l 20 l) contains Ki/ 2 { 2 t) in the expansion. This 
term corresponds to the eigenvalue zero, where the associated eigenfunction is a 
constant. Our surface may also have exceptional eigenvalues 0 < A < |. If this is 
so, for such an eigenvalue A = | — the right hand side above also contains the 
term Ke( 2 t). Furthermore A = |; may also be an eigenvalue, in which case Ko{ 2 t) 
also appears on the right. There is a big difference in asymptotics (for t small) in 
the iF-Bessel functions on the right depending on whether the argument is real or 
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purely imaginary. (The case A = | corresponding to Kq is in a grey area and has 
a logarithmic singularity.) 


Proposition 15. 

— OO 

^ n=0 


len(C)^ 7r-\/2 
vol(X) t 


as t —>■ O'*". 


Proof. We can take care of J2r,,>o as one piece. Let us thus 

consider Kir{z) with r > 0 and z > 0 and small. After integrating 2Kir{z) = 
/r parts once we arrive at 

(50) -/e-^sinh(t)e**’'dt. 

Jr 

Let to{z) be the solution in t of cosh(t) = zsinh^(t). Since z is very small, 1/z is 
very large, and 1/z = ^^^shitolz)) ^ sinh(to( 2 )) since to{z) must be relatively large. 
Now, the function e- 2 cosh(t) jg strictly increasing from 0 to to{z) and strictly 

decreasing from toiz) to oo, with odd symmetry about the origin. This means we 
can kill a lot of area to the right of 0 by the oscillating factor e**’’ in (l50)) : further 
the area to the left of 0 dies also, as long as 

(51) - < to(^). 

r 

The area that does not cancel is around ztto{z). If we use zsinh(t) ^ 1 for t near 
to(z), we see (1501) is bounded by This analysis depends on whether (ISTj) is 

true. 

For z sufficiently small, to{z) ^ log(2/z), and so (ISTl) becomes approximately 
r > iog( 2 /z) • We can take r < Vi where 1/4 + rf is the first eigenvalue larger than 
1/4. Then the part of the sum of (1201) over such r is bounded by (changing z back 
to t) 

o(ri/2). ^ r-2|P(/,„)|2. 

?’n>0 

We need to show convergence of the series, so we integrate by parts again, 

2K„{z) = ^ [ e-"“’*‘'(‘)sinh 2 (t)e**’’ dt -4 [ cosh(t)e**" dt. 

The same type of oscillatory analysis applied to both terms here (separately) yields 

which converges by (PI). 

This leaves only A = 0, and possibly exceptional A = 1/4 — e^, as well as possibly 
A = 1/4. For t > 0 very small, K^it) ^ — log(t/2) — 70 , while for e > 0 we have 
(cf-H; here 70 is Euler’s constant.) Consequently whatever eigen¬ 
values we have left, the A = 0 (i.e., the Ari/ 2 ( 2 t)) term dominates the asymptotics 
of of the spectral side as t —>■ 0 . □ 


Proposition 16. tts [xe j = O as x ^ 00 . In particular Trs{x) = 

0{x^'^‘^) for any e > 0. 
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Proof. It suffices to consider S > 2. We underestimate the regular geometric terms 
using 


(52) 




< Ko 



Ko 



Since we are taking t —)> 0 the factor does not contribute. As above, we have 
Kq {^^t) ^ — log — 7 o, as long as the product is sufficiently small 

(cf. [T]). If we take sufficiently small, by the size of 70 compared to log 2 we 
see we can take 


(53) 



> - log 



Let us now sum over only those 7 for which 
(54) ,5 < _ 2 


in (uni)- For such S, we have log j < [Kq • Thus we see 


^ logI = oQj fort^ 0 +, 


where the left hand side comes from an underestimate of the geometric side of (l20l) 
and the right hand side comes from Proposition [151 

Setting X = l/t, we get the number of is O j which gives 

the above bound. □ 


Proposition 17. For e > 0, tts{x) S>e x^ as x —>■ 00 . 


Proof. We throw away the finite number of <5 in ( 1 ^ for which Kq {^^t) < 
Kq Ko ) as well as the single Kq term on the far left of (1^ . By 

positivity, this gives 

(55) ^ ATp » I as t ^ 0 

by Proposition 1151 where a finite number of 6 have been tossed away. 

Let e, t > 0 and p > 1 all be small. Separate the sum of (1551) into a sum over 
> 1/t^ and a sum over < l/t^. By Proposition [T 6 l Consequently, there 
is a constant Ce > 0 so that By the monotone property of ATo, we 

have 

^ K^Q{{6/2-l)t)< Y. Kl{c,n^-H). 

L^yl/tP Cjni-'>l/tP 


Now so for sufficiently small t, is large and ATq( cen^“'^t) 

will be small due to the exponential decay of Ko^t). From the asymptotic ([T 6 )) . one 
gets 


E 




H )<0 


c.n 


l-ei 
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Now ^ > A? implies t > Ce ^ so the right hand side above is 


/ 


O 


E 


1 


/ 


CfU^ H 


< O 


E 


1 


tP- 


The last term here uses At < Cen^~'^t. The right side above is clearly seen to be 
as the sum converges but depends on e and p. 

We can estimate the remaining terms by 


E ^oit) - (log(t/ 2 ) - 


using again the asymptotics of Ko{t). Here 7rs^(x) means the number of S such 
that 

Piecing everything together, we have 


(log(</ 2 ) - 7 o)^ 7 r«^ (1/tP) + 0^^p(l/tP ^) > 7 - 
2 t 

Recall, we have p is barely larger than 1, but the constant depending on e and p 
could be large. We settle this by writing 






7r ^-2 (1/t) 


H/p log^(t) 


Setting 1/p = 1 — e and x = 1/t proves that 7r^(x) S>£ It is easy to see 

that the same asymptotic lower bound also holds for 7rs(x), and we may absorb the 
log^(x) into e. □ 


7.2. An asymptotic. Let Ci, C 2 , r, Pi and r 2 be as in Section [6l We present 
a special case of a result of Good, which is also valid for P discrete, cofinite. One 
reason [ 6 ] is difficult to understand is that, apart from being dense, the notation is 
quite cumbersome, which is at least partially due to the fact that he is trying to 
treat many cases in a uniform way. (Though even restricted to the case of smooth 
compact Riemann surfaces, the formulas in seem more complicated than ours; 
a simple example is the distinction between 7 and 7 “^ mentioned below.) 

We will explain some of the quantities he considers there in our context, using 


a simplified version of his notation. For a hyperbolic 7 = 



let A^( 7 ) = 


A°g Ifsl ^'^( 7 ) = Ifil (these are denoted by and in [B]). 

For 7 G Fi\r/r 2 which is regular and non-exceptional (S(t~^j) > 2), let us 
write 


N = 




„-|AT7) 


62 


^AR7) 


=-|a77) 



We define iy(j} = \b'\ + |d'| (cf. [B] Lemmal]). We see that b' = b\c/b\^^'^ and 
d' = d\a/d\^^^ so = \ad\^/^ + | 6 cA^. 

Define a generalized Kloosterman sum (denoted {m,n,v) in [ 6 ]) by 


Sr{m, n, v) = i 


len(Ci) 


log 


1/2 


len(C'2) 


log 


1 / 2 ' 
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where e{x) = and the sum runs over 7 S ri\r/r 2 such that ^( 7 ) = u. For 

u > 1 , this is (up to a bounded number of terms) ^^5 5 'g{o 1 } Good’s 

notation. 


Theorem 4. (0 Theorem 4]) As x ^ 00 , 


1 

len(C'i)len(C' 2 ) 


^ S'r(TO,n,u) 

iy<ix 


^0,m^0,n 

7rvol(X) 


0{xn, 


where do,™ = 1 if m = 0 and 0 else, and s is the maximum of | and 1 + 2ir„ for 

0 < A„ < i. 

If in fact there are exceptional eigenvalues (0 < A„ < ^), they each give rise to 
highest order terms than the 0{x^/^), and Good determines what these terms are. 

We set 715 ( 0 ;) = I 7 g 0{X-,C\,C2) : ( 5 (t“^ 7 ) < a;}, i.e., 715 ( 0 ;) is the number 
of curves in the orthogonal spectrum such that ^( 7 ) = 2 cosh(len(a.^)) < x. 


Corollary 3. IdTien Ci = C 2 , we have 


TTsix) 


len(C)^ 

7rvol(X) 


If Cl C 2 , we have the asymptotic bound 


1 

(5(r) 


len(Ci)len(C' 2 ) 

7rvol(X) 


X <C 715 ( 0 ;) <C S{t) 


len(Ci)len(C2) 

7rvol(Af) ^ 


This corollary is actually contained in Good’s Corollary to Theorem 4, where 
he asserts something stronger, though he does not interpret his result in terms of 
ortholengths. 


Proof. Applying the theorem with m = n = 0 gives 


#{76 ri\r/r 2 : ^( 7 ) < 0 ;} 


len(Ci)len(C' 2 ) 2 
7rvol(X) ^ 


0{x^), 


for some s < 2. We note that 1 /( 7 ) = \/'^G)+ 2 +\/'S( 7 ) 2 ^ ^ 

follows that 


#{76 ri\r/r2: <5(7) < 0:} 


len(C'i)len(C' 2 ) 
7rvol(A) ^ 


^( 7 )^. It easily 


which is the first statment. 

We would like to conclude the same result for < 5 (r“^ 7 ), but we only know how 
to bound in terms of S{t) and ; 5 ( 7 ). Precisely, the triangle inequality 


dist (7 • r • ■iffi.'*') < dist (7 • oK’'', oR’'") + dist(r • iM'*", iK.'*") 

implies < gdist( 7 .iR+,*+)gdist(r.iR+,*R+)^ gjjjgg gx < 2 cosh(o;) < 

— 1 , this yields 

d(r“^7) < (5(r)i5(7) — 1. 


Similarly 


^( 7 ) = d{T{T ^ 7 )) < <5(r ^)(5 (t ^ 7 ) — 1 = 5{t)S{t ^ 7 ) — 1. 


The bounds in the second statement now follow. 


□ 
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